Pandas Profiling Report

Dataset statistics

Number of variables	23
Number of observations	1687861
Missing cells	100915
Missing cells (%)	0.3%
Duplicate rows	168735
Duplicate rows (%)	10.0%
Total size in memory	296.2 MiB
Average record size in memory	184.0 B

Variable types

Unsupported	1
Numeric	15
Boolean	7

Alerts

Dataset has 168735 (10.0%) duplicate rows	Duplicates
`national_inv` is highly correlated with `sales_6_month` and 2 other fields	High correlation
`in_transit_qty` is highly correlated with `forecast_3_month` and 7 other fields	High correlation
`forecast_3_month` is highly correlated with `in_transit_qty` and 8 other fields	High correlation
`forecast_6_month` is highly correlated with `in_transit_qty` and 8 other fields	High correlation
`forecast_9_month` is highly correlated with `in_transit_qty` and 8 other fields	High correlation
`sales_1_month` is highly correlated with `in_transit_qty` and 8 other fields	High correlation
`sales_3_month` is highly correlated with `in_transit_qty` and 7 other fields	High correlation
`sales_6_month` is highly correlated with `national_inv` and 9 other fields	High correlation
`sales_9_month` is highly correlated with `national_inv` and 8 other fields	High correlation
`min_bank` is highly correlated with `national_inv` and 8 other fields	High correlation
`perf_6_month_avg` is highly correlated with `perf_12_month_avg`	High correlation
`perf_12_month_avg` is highly correlated with `perf_6_month_avg`	High correlation
`pieces_past_due` is highly correlated with `forecast_3_month` and 4 other fields	High correlation
`lead_time` has 100894 (6.0%) missing values	Missing
`national_inv` is highly skewed (γ1 = 340.2858003)	Skewed
`in_transit_qty` is highly skewed (γ1 = 166.1834042)	Skewed
`forecast_3_month` is highly skewed (γ1 = 138.9683252)	Skewed
`forecast_6_month` is highly skewed (γ1 = 138.9614272)	Skewed
`forecast_9_month` is highly skewed (γ1 = 143.2988747)	Skewed
`sales_1_month` is highly skewed (γ1 = 196.1199899)	Skewed
`sales_3_month` is highly skewed (γ1 = 141.2863795)	Skewed
`sales_6_month` is highly skewed (γ1 = 139.176712)	Skewed
`sales_9_month` is highly skewed (γ1 = 135.0541915)	Skewed
`min_bank` is highly skewed (γ1 = 131.2126489)	Skewed
`pieces_past_due` is highly skewed (γ1 = 412.3919004)	Skewed
`local_bo_qty` is highly skewed (γ1 = 165.1905479)	Skewed
`sku` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`national_inv` has 108425 (6.4%) zeros	Zeros
`in_transit_qty` has 1344662 (79.7%) zeros	Zeros
`forecast_3_month` has 1177722 (69.8%) zeros	Zeros
`forecast_6_month` has 1084111 (64.2%) zeros	Zeros
`forecast_9_month` has 1033241 (61.2%) zeros	Zeros
`sales_1_month` has 959817 (56.9%) zeros	Zeros
`sales_3_month` has 759225 (45.0%) zeros	Zeros
`sales_6_month` has 647038 (38.3%) zeros	Zeros
`sales_9_month` has 585994 (34.7%) zeros	Zeros
`min_bank` has 872331 (51.7%) zeros	Zeros
`pieces_past_due` has 1662571 (98.5%) zeros	Zeros
`perf_6_month_avg` has 39013 (2.3%) zeros	Zeros
`perf_12_month_avg` has 32975 (2.0%) zeros	Zeros
`local_bo_qty` has 1664518 (98.6%) zeros	Zeros

Reproduction

Analysis started	2022-10-23 19:21:51.456137
Analysis finished	2022-10-23 19:25:05.336865
Duration	3 minutes and 13.88 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

sku
Unsupported

REJECTED
UNSUPPORTED

Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

national_inv
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	14969
Distinct (%)	0.9%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	496.1117818

Minimum	-27256
Maximum	12334404
Zeros	108425
Zeros (%)	6.4%
Negative	5888
Negative (%)	0.3%
Memory size	12.9 MiB

Quantile statistics

Minimum	-27256
5-th percentile	0
Q1	4
median	15
Q3	80
95-th percentile	922
Maximum	12334404
Range	12361660
Interquartile range (IQR)	76

Descriptive statistics

Standard deviation	29615.23383
Coefficient of variation (CV)	59.69467954
Kurtosis	131276.5926
Mean	496.1117818
Median Absolute Deviation (MAD)	13
Skewness	340.2858003
Sum	837367232
Variance	877062074.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	108425	6.4%
2	107869	6.4%
3	90577	5.4%
4	69588	4.1%
5	58916	3.5%
1	58829	3.5%
6	50832	3.0%
7	46399	2.7%
10	46277	2.7%
8	40147	2.4%
Other values (14959)	1010001	59.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-27256	1	< 0.1%
-25414	2	< 0.1%
-22154	2	< 0.1%
-17698	1	< 0.1%
-17669	1	< 0.1%
-13491	1	< 0.1%
-9925	1	< 0.1%
-8230	1	< 0.1%
-8170	1	< 0.1%
-8130	1	< 0.1%

Value	Count	Frequency (%)
12334404	1	< 0.1%
12324456	1	< 0.1%
12315072	1	< 0.1%
12309096	1	< 0.1%
12285100	1	< 0.1%
12181612	1	< 0.1%
12166440	1	< 0.1%
6363276	1	< 0.1%
6352932	1	< 0.1%
6335300	1	< 0.1%

lead_time
Real number (ℝ_≥0)

MISSING

Distinct	32
Distinct (%)	< 0.1%
Missing	100894
Missing (%)	6.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.872267035

Minimum	0
Maximum	52
Zeros	10511
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	4
median	8
Q3	9
95-th percentile	12
Maximum	52
Range	52
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	7.056023998
Coefficient of variation (CV)	0.896314107
Kurtosis	26.2372275
Mean	7.872267035
Median Absolute Deviation (MAD)	1
Skewness	4.556295428
Sum	12493028
Variance	49.78747466
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=32)

Value	Count	Frequency (%)
8	682186	40.4%
2	337402	20.0%
12	199700	11.8%
4	128537	7.6%
9	123649	7.3%
52	30113	1.8%
3	16253	1.0%
10	14192	0.8%
0	10511	0.6%
14	10314	0.6%
Other values (22)	34110	2.0%
(Missing)	100894	6.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	10511	0.6%
1	21	< 0.1%
2	337402	20.0%
3	16253	1.0%
4	128537	7.6%
5	4031	0.2%
6	5365	0.3%
7	209	< 0.1%
8	682186	40.4%
9	123649	7.3%

Value	Count	Frequency (%)
52	30113	1.8%
40	48	< 0.1%
35	35	< 0.1%
30	312	< 0.1%
28	84	< 0.1%
26	105	< 0.1%
25	7	< 0.1%
24	115	< 0.1%
23	14	< 0.1%
22	133	< 0.1%

in_transit_qty
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	5230
Distinct (%)	0.3%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	44.05202209

Minimum	0
Maximum	489408
Zeros	1344662
Zeros (%)	79.7%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	68
Maximum	489408
Range	489408
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1342.741731
Coefficient of variation (CV)	30.48081943
Kurtosis	39606.10405
Mean	44.05202209
Median Absolute Deviation (MAD)	0
Skewness	166.1834042
Sum	74353646
Variance	1802955.355
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1344662	79.7%
1	36515	2.2%
2	22236	1.3%
3	17189	1.0%
4	15364	0.9%
5	13003	0.8%
6	11384	0.7%
10	8964	0.5%
8	8822	0.5%
7	8131	0.5%
Other values (5220)	201590	11.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1344662	79.7%
1	36515	2.2%
2	22236	1.3%
3	17189	1.0%
4	15364	0.9%
5	13003	0.8%
6	11384	0.7%
7	8131	0.5%
8	8822	0.5%
9	6285	0.4%

Value	Count	Frequency (%)
489408	1	< 0.1%
487680	1	< 0.1%
328060	1	< 0.1%
327156	1	< 0.1%
292093	1	< 0.1%
288960	1	< 0.1%
288768	1	< 0.1%
285365	1	< 0.1%
276703	1	< 0.1%
254688	1	< 0.1%

forecast_3_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	7825
Distinct (%)	0.5%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	178.1192836

Minimum	0
Maximum	1427612
Zeros	1177722
Zeros (%)	69.8%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	4
95-th percentile	300
Maximum	1427612
Range	1427612
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	5026.553102
Coefficient of variation (CV)	28.22015113
Kurtosis	25637.5503
Mean	178.1192836
Median Absolute Deviation (MAD)	0
Skewness	138.9683252
Sum	300640414
Variance	25266236.09
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1177722	69.8%
1	31452	1.9%
2	26612	1.6%
5	19740	1.2%
4	18563	1.1%
3	16194	1.0%
10	14370	0.9%
6	13612	0.8%
12	11031	0.7%
20	10946	0.6%
Other values (7815)	347618	20.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1177722	69.8%
1	31452	1.9%
2	26612	1.6%
3	16194	1.0%
4	18563	1.1%
5	19740	1.2%
6	13612	0.8%
7	8152	0.5%
8	10357	0.6%
9	6880	0.4%

Value	Count	Frequency (%)
1427612	1	< 0.1%
1218328	2	< 0.1%
1126656	1	< 0.1%
1103084	1	< 0.1%
1058396	1	< 0.1%
1046592	1	< 0.1%
1037228	1	< 0.1%
1013708	1	< 0.1%
992540	1	< 0.1%
980780	1	< 0.1%

forecast_6_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	11114
Distinct (%)	0.7%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	344.9866636

Minimum	0
Maximum	2461360
Zeros	1084111
Zeros (%)	64.2%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	12
95-th percentile	600
Maximum	2461360
Range	2461360
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	9795.151861
Coefficient of variation (CV)	28.39284209
Kurtosis	25189.90379
Mean	344.9866636
Median Absolute Deviation (MAD)	0
Skewness	138.9614272
Sum	582289190
Variance	95944999.99
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1084111	64.2%
1	27857	1.7%
2	26492	1.6%
3	19975	1.2%
4	18782	1.1%
5	16649	1.0%
6	16113	1.0%
10	15810	0.9%
8	12976	0.8%
20	11981	0.7%
Other values (11104)	437114	25.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1084111	64.2%
1	27857	1.7%
2	26492	1.6%
3	19975	1.2%
4	18782	1.1%
5	16649	1.0%
6	16113	1.0%
7	11512	0.7%
8	12976	0.8%
9	6761	0.4%

Value	Count	Frequency (%)
2461360	1	< 0.1%
2446072	1	< 0.1%
2119148	1	< 0.1%
2109740	1	< 0.1%
2104128	1	< 0.1%
2094336	1	< 0.1%
2087396	1	< 0.1%
2085044	1	< 0.1%
2056820	1	< 0.1%
2036828	1	< 0.1%

forecast_9_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	13662
Distinct (%)	0.8%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	506.3644307

Minimum	0
Maximum	3777304
Zeros	1033241
Zeros (%)	61.2%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	20
95-th percentile	896
Maximum	3777304
Range	3777304
Interquartile range (IQR)	20

Descriptive statistics

Standard deviation	14378.92356
Coefficient of variation (CV)	28.39639337
Kurtosis	27048.45231
Mean	506.3644307
Median Absolute Deviation (MAD)	0
Skewness	143.2988747
Sum	854672268
Variance	206753442.8
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1033241	61.2%
1	26781	1.6%
2	25662	1.5%
3	20716	1.2%
4	19322	1.1%
5	17495	1.0%
6	16611	1.0%
10	16153	1.0%
8	13953	0.8%
12	12425	0.7%
Other values (13652)	485501	28.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1033241	61.2%
1	26781	1.6%
2	25662	1.5%
3	20716	1.2%
4	19322	1.1%
5	17495	1.0%
6	16611	1.0%
7	10402	0.6%
8	13953	0.8%
9	8012	0.5%

Value	Count	Frequency (%)
3777304	1	< 0.1%
3760840	1	< 0.1%
3232820	1	< 0.1%
3229292	1	< 0.1%
3206948	1	< 0.1%
3196364	1	< 0.1%
3158732	1	< 0.1%
3149324	1	< 0.1%
3103460	1	< 0.1%
3062016	1	< 0.1%

sales_1_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	5764
Distinct (%)	0.3%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	55.92606851

Minimum	0
Maximum	741774
Zeros	959817
Zeros (%)	56.9%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	4
95-th percentile	107
Maximum	741774
Range	741774
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	1928.195879
Coefficient of variation (CV)	34.47758675
Kurtosis	53855.92556
Mean	55.92606851
Median Absolute Deviation (MAD)	0
Skewness	196.1199899
Sum	94395374
Variance	3717939.347
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	959817	56.9%
1	144881	8.6%
2	78759	4.7%
3	49410	2.9%
4	37905	2.2%
5	29720	1.8%
6	23695	1.4%
7	18997	1.1%
8	17003	1.0%
10	14605	0.9%
Other values (5754)	313068	18.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	959817	56.9%
1	144881	8.6%
2	78759	4.7%
3	49410	2.9%
4	37905	2.2%
5	29720	1.8%
6	23695	1.4%
7	18997	1.1%
8	17003	1.0%
9	13983	0.8%

Value	Count	Frequency (%)
741774	1	< 0.1%
741762	1	< 0.1%
741750	1	< 0.1%
393665	1	< 0.1%
376025	1	< 0.1%
369425	1	< 0.1%
366191	1	< 0.1%
361803	1	< 0.1%
361239	1	< 0.1%
359505	1	< 0.1%

sales_3_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	10495
Distinct (%)	0.6%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	175.0259305

Minimum	0
Maximum	1105478
Zeros	759225
Zeros (%)	45.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	15
95-th percentile	350
Maximum	1105478
Range	1105478
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	5192.377625
Coefficient of variation (CV)	29.6663335
Kurtosis	24198.86065
Mean	175.0259305
Median Absolute Deviation (MAD)	1
Skewness	141.2863795
Sum	295419267
Variance	26960785.4
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	759225	45.0%
1	136966	8.1%
2	81289	4.8%
3	53082	3.1%
4	41533	2.5%
5	34128	2.0%
6	27829	1.6%
7	23243	1.4%
8	20904	1.2%
10	17873	1.1%
Other values (10485)	491788	29.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	759225	45.0%
1	136966	8.1%
2	81289	4.8%
3	53082	3.1%
4	41533	2.5%
5	34128	2.0%
6	27829	1.6%
7	23243	1.4%
8	20904	1.2%
9	17571	1.0%

Value	Count	Frequency (%)
1105478	1	< 0.1%
1104181	1	< 0.1%
1100523	1	< 0.1%
1094112	1	< 0.1%
1091281	1	< 0.1%
1084974	1	< 0.1%
1081560	1	< 0.1%
1076623	1	< 0.1%
1070623	1	< 0.1%
1062979	1	< 0.1%

sales_6_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	14818
Distinct (%)	0.9%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	341.7288395

Minimum	0
Maximum	2146625
Zeros	647038
Zeros (%)	38.3%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	2
Q3	31
95-th percentile	696
Maximum	2146625
Range	2146625
Interquartile range (IQR)	31

Descriptive statistics

Standard deviation	9613.167104
Coefficient of variation (CV)	28.13097987
Kurtosis	24305.44501
Mean	341.7288395
Median Absolute Deviation (MAD)	2
Skewness	139.176712
Sum	576790439
Variance	92412981.77
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	647038	38.3%
1	127076	7.5%
2	79418	4.7%
3	52987	3.1%
4	41716	2.5%
5	34108	2.0%
6	28319	1.7%
7	23244	1.4%
8	21102	1.3%
9	18383	1.1%
Other values (14808)	614469	36.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	647038	38.3%
1	127076	7.5%
2	79418	4.7%
3	52987	3.1%
4	41716	2.5%
5	34108	2.0%
6	28319	1.7%
7	23244	1.4%
8	21102	1.3%
9	18383	1.1%

Value	Count	Frequency (%)
2146625	1	< 0.1%
2145715	1	< 0.1%
2133557	1	< 0.1%
2123946	1	< 0.1%
2117803	1	< 0.1%
2113901	1	< 0.1%
2112231	1	< 0.1%
2098852	1	< 0.1%
2086531	1	< 0.1%
1799099	1	< 0.1%

sales_9_month
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	18341
Distinct (%)	1.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	525.2697007

Minimum	0
Maximum	3205172
Zeros	585994
Zeros (%)	34.7%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	4
Q3	47
95-th percentile	1060
Maximum	3205172
Range	3205172
Interquartile range (IQR)	47

Descriptive statistics

Standard deviation	14838.61352
Coefficient of variation (CV)	28.24951354
Kurtosis	22844.80575
Mean	525.2697007
Median Absolute Deviation (MAD)	4
Skewness	135.0541915
Sum	886581717
Variance	220184451.3
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	585994	34.7%
1	120294	7.1%
2	76521	4.5%
3	52294	3.1%
4	41399	2.5%
5	34323	2.0%
6	28784	1.7%
7	23545	1.4%
8	21115	1.3%
9	18744	1.1%
Other values (18331)	684847	40.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	585994	34.7%
1	120294	7.1%
2	76521	4.5%
3	52294	3.1%
4	41399	2.5%
5	34323	2.0%
6	28784	1.7%
7	23545	1.4%
8	21115	1.3%
9	18744	1.1%

Value	Count	Frequency (%)
3205172	1	< 0.1%
3204929	1	< 0.1%
3201035	1	< 0.1%
3197338	1	< 0.1%
3182148	1	< 0.1%
3167394	1	< 0.1%
3163794	1	< 0.1%
3120875	1	< 0.1%
3119450	1	< 0.1%
2758103	1	< 0.1%

min_bank
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	5568
Distinct (%)	0.3%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	52.77230339

Minimum	0
Maximum	313319
Zeros	872331
Zeros (%)	51.7%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	3
95-th percentile	125
Maximum	313319
Range	313319
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1254.983089
Coefficient of variation (CV)	23.78109364
Kurtosis	23549.24009
Mean	52.77230339
Median Absolute Deviation (MAD)	0
Skewness	131.2126489
Sum	89072260
Variance	1574982.553
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	872331	51.7%
1	252498	15.0%
2	113010	6.7%
3	36035	2.1%
4	22180	1.3%
5	15929	0.9%
6	12059	0.7%
7	9574	0.6%
8	7841	0.5%
15	7375	0.4%
Other values (5558)	339028	20.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	872331	51.7%
1	252498	15.0%
2	113010	6.7%
3	36035	2.1%
4	22180	1.3%
5	15929	0.9%
6	12059	0.7%
7	9574	0.6%
8	7841	0.5%
9	6083	0.4%

Value	Count	Frequency (%)
313319	1	< 0.1%
311423	1	< 0.1%
310427	1	< 0.1%
309667	1	< 0.1%
308055	1	< 0.1%
307627	1	< 0.1%
291059	1	< 0.1%
205786	1	< 0.1%
204803	1	< 0.1%
203734	1	< 0.1%

potential_issue
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1686953
True	907
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1686953	99.9%
True	907	0.1%
(Missing)	1	< 0.1%

pieces_past_due
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	826
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	2.043724006

Minimum	0
Maximum	146496
Zeros	1662571
Zeros (%)	98.5%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	146496
Range	146496
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	236.0164997
Coefficient of variation (CV)	115.4835482
Kurtosis	207663.2258
Mean	2.043724006
Median Absolute Deviation (MAD)	0
Skewness	412.3919004
Sum	3449520
Variance	55703.78813
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1662571	98.5%
1	3917	0.2%
2	2187	0.1%
4	1294	0.1%
3	1217	0.1%
5	1077	0.1%
6	836	< 0.1%
12	763	< 0.1%
10	744	< 0.1%
8	625	< 0.1%
Other values (816)	12629	0.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1662571	98.5%
1	3917	0.2%
2	2187	0.1%
3	1217	0.1%
4	1294	0.1%
5	1077	0.1%
6	836	< 0.1%
7	488	< 0.1%
8	625	< 0.1%
9	401	< 0.1%

Value	Count	Frequency (%)
146496	1	< 0.1%
137625	1	< 0.1%
98776	1	< 0.1%
87689	1	< 0.1%
83600	1	< 0.1%
74084	1	< 0.1%
61144	1	< 0.1%
59136	1	< 0.1%
36452	1	< 0.1%
34368	1	< 0.1%

perf_6_month_avg
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	102
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	-6.872058838

Minimum	-99
Maximum	1
Zeros	39013
Zeros (%)	2.3%
Negative	129478
Negative (%)	7.7%
Memory size	12.9 MiB

Quantile statistics

Minimum	-99
5-th percentile	-99
Q1	0.63
median	0.82
Q3	0.97
95-th percentile	1
Maximum	1
Range	100
Interquartile range (IQR)	0.34

Descriptive statistics

Standard deviation	26.55635677
Coefficient of variation (CV)	-3.864396013
Kurtosis	8.117395115
Mean	-6.872058838
Median Absolute Deviation (MAD)	0.15
Skewness	-3.180621807
Sum	-11599073.23
Variance	705.2400851
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.99	143757	8.5%
1	132329	7.8%
-99	129478	7.7%
0.73	106468	6.3%
0.98	83611	5.0%
0.97	62531	3.7%
0.78	46262	2.7%
0.95	44152	2.6%
0.96	39850	2.4%
0.82	39591	2.3%
Other values (92)	859831	50.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-99	129478	7.7%
0	39013	2.3%
0.01	572	< 0.1%
0.02	1053	0.1%
0.03	703	< 0.1%
0.04	652	< 0.1%
0.05	1218	0.1%
0.06	1145	0.1%
0.07	2303	0.1%
0.08	1674	0.1%

Value	Count	Frequency (%)
1	132329	7.8%
0.99	143757	8.5%
0.98	83611	5.0%
0.97	62531	3.7%
0.96	39850	2.4%
0.95	44152	2.6%
0.94	36733	2.2%
0.93	34815	2.1%
0.92	22360	1.3%
0.91	31151	1.8%

perf_12_month_avg
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	102
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	-6.437946743

Minimum	-99
Maximum	1
Zeros	32975
Zeros (%)	2.0%
Negative	122050
Negative (%)	7.2%
Memory size	12.9 MiB

Quantile statistics

Minimum	-99
5-th percentile	-99
Q1	0.66
median	0.81
Q3	0.95
95-th percentile	0.99
Maximum	1
Range	100
Interquartile range (IQR)	0.29

Descriptive statistics

Standard deviation	25.84333121
Coefficient of variation (CV)	-4.014219477
Kurtosis	8.905503219
Mean	-6.437946743
Median Absolute Deviation (MAD)	0.15
Skewness	-3.302181248
Sum	-10866352.79
Variance	667.8777679
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.99	132425	7.8%
-99	122050	7.2%
0.78	117662	7.0%
0.98	92825	5.5%
0.97	66029	3.9%
0.96	63441	3.8%
0.66	53184	3.2%
0.9	47174	2.8%
0.95	45728	2.7%
1	43675	2.6%
Other values (92)	903667	53.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-99	122050	7.2%
0	32975	2.0%
0.01	2458	0.1%
0.02	420	< 0.1%
0.03	563	< 0.1%
0.04	1026	0.1%
0.05	646	< 0.1%
0.06	817	< 0.1%
0.07	1141	0.1%
0.08	1496	0.1%

Value	Count	Frequency (%)
1	43675	2.6%
0.99	132425	7.8%
0.98	92825	5.5%
0.97	66029	3.9%
0.96	63441	3.8%
0.95	45728	2.7%
0.94	38752	2.3%
0.93	31870	1.9%
0.92	30160	1.8%
0.91	29820	1.8%

local_bo_qty
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	654
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	0.6264506535

Minimum	0
Maximum	12530
Zeros	1664518
Zeros (%)	98.6%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	12530
Range	12530
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	33.72224156
Coefficient of variation (CV)	53.83064312
Kurtosis	38154.95546
Mean	0.6264506535
Median Absolute Deviation (MAD)	0
Skewness	165.1905479
Sum	1057361
Variance	1137.189576
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1664518	98.6%
1	7151	0.4%
2	2982	0.2%
3	1716	0.1%
4	1224	0.1%
5	979	0.1%
6	686	< 0.1%
7	552	< 0.1%
10	504	< 0.1%
8	444	< 0.1%
Other values (644)	7104	0.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1664518	98.6%
1	7151	0.4%
2	2982	0.2%
3	1716	0.1%
4	1224	0.1%
5	979	0.1%
6	686	< 0.1%
7	552	< 0.1%
8	444	< 0.1%
9	348	< 0.1%

Value	Count	Frequency (%)
12530	1	< 0.1%
10045	1	< 0.1%
10024	1	< 0.1%
8600	1	< 0.1%
7812	1	< 0.1%
7048	1	< 0.1%
7000	1	< 0.1%
6965	1	< 0.1%
6955	1	< 0.1%
6732	1	< 0.1%

deck_risk
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1300377
True	387483
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1300377	77.0%
True	387483	23.0%
(Missing)	1	< 0.1%

oe_constraint
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1687615
True	245
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1687615	> 99.9%
True	245	< 0.1%
(Missing)	1	< 0.1%

ppap_risk
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1484026
True	203834
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1484026	87.9%
True	203834	12.1%
(Missing)	1	< 0.1%

stop_auto_buy
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

True	1626774
False	61086
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
True	1626774	96.4%
False	61086	3.6%
(Missing)	1	< 0.1%

rev_stop
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1687129
True	731
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1687129	> 99.9%
True	731	< 0.1%
(Missing)	1	< 0.1%

went_on_backorder
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	3.2 MiB

False	1676567
True	11293
(Missing)	1

Common Values
Category Frequency Plot

Value	Count	Frequency (%)
False	1676567	99.3%
True	11293	0.7%
(Missing)	1	< 0.1%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	sku	national_inv	lead_time	forecast_3_month	forecast_6_month	forecast_9_month	sales_9_month	min_bank	potential_issue	perf_6_month_avg	perf_12_month_avg	deck_risk	oe_constraint	ppap_risk	stop_auto_buy	rev_stop	went_on_backorder
0	1026827	0.0	NaN	0.0	0.0	0.0	0.0	0.0	No	-99.00	-99.00	No	No	No	Yes	No	No
1	1043384	2.0	9.0	0.0	0.0	0.0	0.0	0.0	No	0.99	0.99	No	No	No	Yes	No	No
2	1043696	2.0	NaN	0.0	0.0	0.0	0.0	0.0	No	-99.00	-99.00	Yes	No	No	Yes	No	No
3	1043852	7.0	8.0	0.0	0.0	0.0	0.0	1.0	No	0.10	0.13	No	No	No	Yes	No	No
4	1044048	8.0	NaN	0.0	0.0	0.0	4.0	2.0	No	-99.00	-99.00	Yes	No	No	Yes	No	No
5	1044198	13.0	8.0	0.0	0.0	0.0	0.0	0.0	No	0.82	0.87	No	No	No	Yes	No	No
6	1044643	1095.0	NaN	0.0	0.0	0.0	0.0	4.0	No	-99.00	-99.00	Yes	No	No	Yes	No	No
7	1045098	6.0	2.0	0.0	0.0	0.0	0.0	0.0	No	0.00	0.00	Yes	No	Yes	Yes	No	No
8	1045815	140.0	NaN	15.0	114.0	152.0	0.0	0.0	No	-99.00	-99.00	No	No	No	Yes	No	No
9	1045867	4.0	8.0	0.0	0.0	0.0	0.0	0.0	No	0.82	0.87	No	No	No	Yes	No	No

Last rows

	sku	national_inv	lead_time	in_transit_qty	forecast_3_month	forecast_6_month	forecast_9_month	sales_1_month	sales_3_month	sales_6_month	sales_9_month	min_bank	potential_issue	pieces_past_due	perf_6_month_avg	perf_12_month_avg	local_bo_qty	deck_risk	oe_constraint	ppap_risk	stop_auto_buy	rev_stop	went_on_backorder
1687851	1373539	-6.0	9.0	36.0	130.0	130.0	130.0	0.0	0.0	54.0	57.0	3.0	No	0.0	0.03	0.10	42.0	No	No	No	Yes	No	No
1687852	1478683	2.0	8.0	0.0	966.0	966.0	1116.0	47.0	512.0	1361.0	2060.0	455.0	No	0.0	0.84	0.77	46.0	No	No	No	Yes	No	No
1687853	1489920	0.0	2.0	0.0	2071.0	3025.0	3412.0	4.0	764.0	764.0	765.0	657.0	No	0.0	0.98	0.99	4.0	No	No	No	No	No	Yes
1687854	1392420	124.0	8.0	140.0	410.0	780.0	1240.0	128.0	464.0	849.0	1074.0	111.0	No	0.0	0.85	0.90	1.0	No	No	No	Yes	No	No
1687855	1407754	0.0	2.0	0.0	10.0	10.0	10.0	0.0	5.0	7.0	7.0	0.0	No	0.0	0.69	0.69	5.0	Yes	No	No	Yes	No	No
1687856	1373987	-1.0	NaN	0.0	5.0	7.0	9.0	1.0	3.0	3.0	8.0	0.0	No	0.0	-99.00	-99.00	1.0	No	No	No	Yes	No	No
1687857	1524346	-1.0	9.0	0.0	7.0	9.0	11.0	0.0	8.0	11.0	12.0	0.0	No	0.0	0.86	0.84	1.0	Yes	No	No	No	No	Yes
1687858	1439563	62.0	9.0	16.0	39.0	87.0	126.0	35.0	63.0	153.0	205.0	12.0	No	0.0	0.86	0.84	6.0	No	No	No	Yes	No	No
1687859	1502009	19.0	4.0	0.0	0.0	0.0	0.0	2.0	7.0	12.0	20.0	1.0	No	0.0	0.73	0.78	1.0	No	No	No	Yes	No	No
1687860	(1687860 rows)	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN

Most frequently occurring

	national_inv	lead_time	min_bank	potential_issue	perf_6_month_avg	perf_12_month_avg	deck_risk	oe_constraint	ppap_risk	stop_auto_buy	rev_stop	went_on_backorder	# duplicates
12400	0.0	NaN	0.0	No	-99.00	-99.00	No	No	No	Yes	No	No	6921
27798	2.0	12.0	0.0	No	0.78	0.78	No	No	No	Yes	No	No	3140
21699	2.0	4.0	0.0	No	0.73	0.78	No	No	No	Yes	No	No	2690
91559	13.0	12.0	1.0	No	0.48	0.48	Yes	No	No	Yes	No	No	2683
27757	2.0	12.0	0.0	No	0.63	0.72	No	No	No	Yes	No	No	2534
80254	10.0	12.0	1.0	No	0.48	0.48	Yes	No	No	Yes	No	No	2253
37504	3.0	12.0	0.0	No	0.63	0.72	No	No	No	Yes	No	No	2169
27778	2.0	12.0	0.0	No	0.73	0.79	No	No	No	Yes	No	No	2163
91562	13.0	12.0	1.0	No	0.58	0.58	Yes	No	No	Yes	No	No	2137
26693	2.0	9.0	0.0	No	0.70	0.66	No	No	No	Yes	No	No	2082

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequently occurring